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Abstract 

This paper addresses the time-optimal control problem for a class of 
control systems which includes controlled mechanical systems with possi- 
ble dissipation terms. The Lie algebras associated with such mechanical 
systems enjoy certain special properties. These properties are explored 
and are used in conjunction with the Pontryagin maximum principle to 
determine the structure of singular extremals and, in particular, time- 
optimal trajectories. The theory is illustrated with an application to a 
time-optimal problem for a class of underwater vehicles. 
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1 Introduction 



In studying and designing controllers for physical processes, optimality of tra- 
jectories with respect to a given criterion is often a central concern. One might 
desire, for instance, to minimize the amount of fuel used by an airplane, or the 
energy spent by a given robotic system in order to reach a desired configuration. 
Similarly, one may wish to minimize flight time or operating time, since lengthy 
control efforts may be costly. In this paper, we focus on the time-optimal prob- 
lem for a class of systems that includes controlled mechanical systems, such as 
rigid manipulators or underwater vehicles, for which we generally have more 
than one control. Controlled mechanical systems are of interest because of their 
practical significance in many applications and because of the special structure 
associated with the vector fields that define their dynamics. It is this structure 
that we make use of in this paper to better understand optimality of trajectories. 

We consider both fully actuated and underactuated control systems. A first 
study on fully actuated conservative controlled mechanical systems was carried 
out in pC, 11 . As in that work, we base our study on the Pontryagin maximum 



principle, which gives necessary conditions for trajectories of control systems to 
be optimal with respect to a criterion such as energy or time. The idea is that 
one may associate, to any given controlled mechanical system, a set of vector 
fields describing the control system. Then, from the special form of the Lie 
algebra generated by these vector fields, one may extract from the maximum 
principle information on the structure of optimal trajectories. More precisely, 
according to the maximum principle, a time-optimal trajectory can be lifted to 
the cotangent bundle of its phase space as a trajectory of a constrained Hamil- 
tonian system. This trajectory, combined with the corresponding control, is 
called an extremal. When the pointwisc constraints in the maximum principle 
are nontrivial, one has nonsingular trajectories. These lead to boundary-valued 
controls, determined by the signs of the associated switching functions. How- 
ever, it is well-known that an optimal trajectory may well be singular; that is, 
switching functions may vanish identically along the trajectory. The charac- 
terization of such trajectories, which is the question addressed in this paper, is 
in general a highly nontrivial problem. See for instance || and |14[ for a 
systematic use of Lie-algebraic techniques to restrict the trajectories candidates 
to time optimality. 

Our main theorem gives conditions for the existence of singular extremals 
and the existence of trajectories with an infinite number of switchings. For 
instance, we can deduce from that theorem, for controlled mechanical systems 
with external forces, the nonexistence of totally singular extremals in the fully 
actuated situation (this result was already proved in ) . We also give results 
on the possibility of concatenations of singular trajectories. In the case of un- 
derwater vehicles, we use these results to show that certain trajectories are not 
optimal. 

While we focus here on mechanical systems (with the possibility of dissipative 
forcing), we note that our main result can be applied to other types of systems 
including nonholonomic robots. 
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In this paper, we perform computations using coordinates. However, it is 
of interest to translate our conditions into a coordinate-free formulation and to 
further study the geometry of our results. A geometrical approach to studying 
optimal problems associated with mechanical systems has been initiated in || . 

This paper is organized as follows. In Section || we state the problem and 
focus on the special class of affine control systems represented by controlled 
mechanical systems with external forces. In Section ||, we first recall the neces- 
sary conditions from the maximum principle for a trajectory of an affine control 
system to be time-optimal and introduce the switching functions which are the 
key tool to characterize the time-optimal trajectories. Then, we state and prove 
the main result with a specific application to the case of controlled mechanical 
systems. Section || is dedicated to the study of an application to illustrate the 
use of our main theorem. We treat the time-optimal problem for underwater 
vehicles and describe the singular trajectories. 

2 Statement of the problem 

In mechanics and robotics, most systems are described by an affine control 
system on a smooth n-dimensional manifold M (for Lagrangian systems with 
configuration space Q, phase space is M. = TQ). An affine control system on 
M takes the form 

m 

x(t) = f(x(t))+Y,9i(x(t)) Ui (t), x{t)eM (1) 

i=l 

where u : [0,T]^Uc JT is a measurable bounded function called the control, 
f is a smooth vector field on M., and the smooth vector fields gi are assumed 
to be linearly independent. They arc called the control vector fields. The vector 
field / is called the drift and represents the dynamics of the system. For a given 
control u(.) defined on a time interval [0, T] and an initial condition x(0) = xo, a 
solution x(.) of (0) is an absolutely continuous function defined on a sub-interval 

of [o,n 

In this paper we will make the following assumption on the control- value set: 
Assumption 1. The domain of control is given by 

U = {ue M m ; a, < u t < fa, i = 1, • • • , m, a t < < fa}. (2) 

Such constraints on the inputs are very natural as the control usually represents 
quantities such as acceleration, temperature, etc., that cannot take arbitrarily 
big values. In the sequel an admissible control will refer to a measurable bounded 
function u(.) defined on some interval [0, T] such that u(t) G U for almost every 
t. 

We are interested in physical processes that can be governed; hence, it is 
natural to ask for the best control with respect to a given performance crite- 
rion. In this paper we focus on the time-optimal problem. The initial state and 
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the target state of the system will be assumed to be points in the phase space 
M. . To summarize, we shall consider the following problem: given Xi,Xf G M 
as initial and final states, find an admissible control u(.) such that the corre- 
sponding trajectory steers the system ([!]) from to Xf in the shortest time. 

A key tool in our study will be the Lie algebra generated by the vector fields 
describing the system. 

Definition 1 Let X,Y be two smooth vector fields in A4. Their Lie bracket 
denoted by [X, Y] is given by [X, Y] — XY — Y X . The set of vector fields in M. 
endowed with the Lie bracket operation is a Lie algebra denoted by V°°{M). 
In the sequel Cq will denote the smallest sub-algebra ofV°°(M) that contains 



2.1 Controlled mechanical systems 

Controlled mechanical systems arise as follows. One starts with the specification 
of a Lagrangian of the form "kinetic minus potential energy" . The kinetic energy 
is given by a Riemannian metric on the configuration manifold Q. If we denote 
by q = (<7i, • • • , q r ) the local coordinates of the configuration manifold (r is the 
number of degrees of freedom of the system), the Lagrangian defined on the 
phase space, L : TQ — > M, has the following expression in the local coordinates 
(q,q) on TQ: 

L(q,q) = ^q t M(q)q-V(q), 

where M(q) is a symmetric positive definite r x r matrix and V{q) is a scalar 
function, the potential energy. We assume M and V are smooth with respect to 
q. The unforced equations of motion are given by the Euler-Lagrange equations 
and can be written in the form 

M(q)q + C(q,q)q+— =0 

where 

C(q, q)q = ^ (M(q)q) q - ^ Q^Af^)^ . (3) 

The term C(q,q)q, which is quadratic in q, accounts for centrifugal and Cori- 
olis forces. We also consider dissipation terms as well as other forces such as 
aerodynamics forces from fixed surfaces; we refer to these additional forces as 
external forces and collect them into an r-dimensional vector D(q, q). To model 
the action of external controls, we introduce a smooth r x m matrix Q(q) of 
rank m, and write the equations of motion in local coordinates in the form 
Q(q)u = M(q)q + N(q, q), where 

N(q 7 q) = C(q,q)q+— (q) - D(q,q) 
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is a smooth r-dimensional vector and u(.) an admissible control. (Assuming 
that Q depends only on configuration variables, and not velocities, means that 
we cannot include in the scope of our study some systems of interest, such as 
those involving control inputs corresponding to controlled surfaces on a moving 
body.) We will call the control system conservative (when u — 0) if D = 0; this 
implies that the energy E = \q l Mq + V is conserved. The above discussion 
leads to the following definition. 

Definition 2 A controlled mechanical system is a system whose equations 
of motion are given in local coordinates by 



where M(q) is a symmetric positive definite r x r matrix, N(q, q) is an r- 
dimensional vector and Q{q) is an r x m matrix of rank m. The function 
u : [0, T] — ► U is an admissible control as defined previously. All objects are as- 
sumed to be smooth. External forces ( other than control forces ) are included in 
the vector N . We say that (0) represents a controlled mechanical system with 
quadratic external forces if N(q,q) is quadratic as a function of q. The 
system is called conservative if N{q,q) = C(q,q)q+ ^ (q) for C(q,q)q given 
by ||) and for some smooth V . When m — r (same number of input forces as 
number degrees of freedom), the system is fully actuated. It is underactuated if 
m < r. 

From now on, we will assume that the configuration manifold Q is the Eu- 
clidean space 1R T . As most of our results are local in nature, in applications they 
will apply to trajectories staying in a fixed chart. In the sequel, we introduce a 
smooth n x m— matrix G whose columns are the vector fields gi. Hence G is of 
rank in and the system (Q) can be rewritten as: 



A controlled mechanical system can be written as a control system of the 
form When working with applications, sec for instance Section it is 

sometimes convenient to consider the following change of variables on the phase 
space from configuration variables and velocities x — (q, q) : 

• X\ = ijj(q) £ lR r , where q <— * ip(q) is a smooth diffeomorphism; 

• X2 — P{q)q € 1R T , where P(q) is a smooth n x n invertible matrix. 

Given such tp and P, the equations of motion (||) lead us to an affine control 
system ([!]) where x = {x\,X2) and n = 2r. More precisely, the drift is given by 



Q(q(t))u(t) = M(q(t))q(t)+N(q(t),q(t)), 



q(t) G Q 



(4) 



±(t) = f{x(t)) + G(x(t))u(t), x{t) g M' 



(5) 





F(xi) = ~rP-\ f(x 1 ,x 2 ) = PP- 1 x 2 - PM- 1 N( 1 p-\x 1 ),p- 1 x 2 ) 
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and the control vector fields by 

G(x) = ( J I ) , G(xi) = PM- l Q (7) 

V ^ 1 ' / 2rxm 

the argument of the matrices being il)~ 1 (xi). Note that F is an invertible matrix 
of rank r. If the mechanical system is conservative or with quadratic external 
forces, / is of order 2 as a function of xi. We denote by (gi(xi))i=i.... m the 
columns of the r x to matrix G and note that gi = (0,#j)*. Note that the 
vectors gi are linearly independent, because the matrix Q was assumed to be of 
rank to, so for the fully actuated situation G is an invertible r x r matrix. 



2.1.1 Lie algebra associated to controlled mechanical systems 

We already discussed the fact that one may naturally associate a Lie algebra of 
vector fields C G to any controlled system. We now turn to a discussion of several 
special properties of L G which hold whenever the control system in question is 
derived from a controlled mechanical system. The first essential property in our 
study is the commutativity condition satisfied by the vector fields gi. Define 
J = {l,--.,m}. 

Lemma 1 A controlled mechanical system satisfies the following commutativity 
condition: 

[9i,9j]=0, i,3 = l,---,m. (8) 

Moreover, the vector fields {gi, [f,gi]}iei are pointwise linearly independent. If 
the system is fully actuated, the set of vector fields {gi,[f, gi]}iei generates, as 
a module over smooth functions, the set of all smooth vector fields on the phase 
space M 2r . 

Proof. The columns of G{x) are functions of the first r state variables only, and 
their first r components are zero. As a consequence, the relation [gi,gf\ — is 
verified for all i, j G /. Moreover, computing the Lie brackets of the drift and 
the control vector fields we have: 

\t „i _ ( -F(xi)gi(xi) \ 
V>M-\ h i (x 1 ,x 2 ) J 

where hi is given by: 




Since G is a matrix of rank to and F is invertible, the family of vector fields 
{gi, [f,gi]}iei is linearly independent at every x. 

Next, we make some preliminary remarks regarding the structure of Lie 
algebras generated by vector fields which have a polynomial structure in some 
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of the variables; later we apply these remarks to controlled mechanical systems 
for which the external forces are polynomial as a function of q. 

By convention, we say that the polynomial "0" has degree —1. Assume we 
are given two vector fields X, Y on M n with the following properties: if we 
denote x = (x\, x 2 ) S M ni x J?" 2 , with n\ + n 2 = n, then: 

• As a function of x 2 , the first n\ coordinates of X are polynomials of degree 
at most a, and the last n 2 of degree at most b. 

• As a function of x 2 , the first n\ coordinates of Y are polynomials of degree 
at most c, and the last n 2 of degree at most d. 

Then, as a function of x 2 , the first n\ coordinates of the Lie bracket [X, Y] are 
polynomial of degree at most max(a + c, a + d — 1,6 + c— 1) and the last n 2 of 
degree at most max(6 + c, a + d, b + d— 1) with the convention that if a (resp. 6, c 
or d) is negative then any term in these expressions containing a (resp. 6, c or d) 
is -1, corresponding to the polynomial 0. In the sequel, V^ ,b will denote the set 
of vector fields in M n whose first m coordinates are polynomial in x 2 of degree 
at most a and the last n 2 coordinates (n 2 = n — m) are polynomial in x 2 of 
degree at most b. 

Of course, by adding more polynomial structure on the vector fields, we can 
obtain more conditions on the structure of the Lie brackets, but for our purposes 
the situation considered here is sufficient. 

We now apply the above observation about degrees to controlled mechanical 
systems. In this case, we have n — 2r and n\ = n 2 = r. 

Lemma 2 Assume that the external forces acting on a controlled mechanical 
system are polynomial, which means N(q,q) is a polynomial as a function of q. 
Then f G V,}' b for some b>2 (in particular, 6 = 2 if the system is conservative), 
and as gi e V~ lfl , we have: 

ad s f9i e V (s-^s+hsb-s^ [g J ,ad}g l }eV^- 1 '> b -^ sb - s - 1 (10) 

for i,j = 1 ■ • ■ ,m. If the system is conservative or the external forces are of 
degree at most 2 as functions of x 2 , then 

feK 1 ' 2 , ad s f9i ev r s - hs ,ys>0, (n) 

for i,j = l---,m. 

Corollary 1 If a controlled mechanical system is fully actuated: m = r , the Lie 
brackets of the form [gj, [/, g t ]] belong to the module over the smooth functions 
on M 2r generated by the vector fields gi. 
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3 Time-optimality 



We are interested in time-optimal trajectories for affine control systems: 

x(t) = f(x(t))+G(x(t))u(t) (12) 

where x(t) £ X = R n (local study). Our study is based on the maximum 
principle, which provides necessary conditions for a trajectory to be optimal. 
For a general statement of the maximum principle, see and 1 13 for instance. 



In the next section, we state the necessary conditions for our specific problem. 
3.1 Maximum principle 

Let Xi,Xf G R n be fixed, and suppose given an admissible time-optimal control 
u : 0, T] — > U such that the corresponding time-optimal trajectory x(.) solution 
of ( Lq) is defined on [0, T] and steers the system from Xi to Xf. 

Using the maximum principle, we conclude that there exists an absolutely 
continuous vector A : [0, T] — > R n , X(t) ^ for all t, such that the following 
conditions hold almost everywhere: 

Xj(t) = g^(X(t),x(t),u(t)), Xj(t) = - — (\(t),x(t),u(t)) (13) 

for j = 1, • • • , n, where if (A, x, u) — A*/(x) + J^., X t gi(x)ui is the Hamiltonian 
function, and the maximum condition holds: 

H(X(t), x{t), u(t)) = maxif(A(t), x(t), v). (14) 

Moreover, the Hamiltonian is constant along the solutions of ( fL3| ) and must 
satisfy H(X(t),x(t),u(t)) = A , A > 0. 

Definition 3 A triple (x, A, u) which satisfies the maximum principle, in the 
sense just stated, is called an extremal. Its projection on the state space x(-) is 
said to be a geodesic, and the vector function A(-) an adjoint vector. When 
the constant Ao is zero, the extremal is said to be abnormal. 

The maximum principle does not imply existence of optimal controls; for 
existence theorems the reader should refer to j|] for instance. As A(-) is the 
solution of a linear differential equation, the condition "X(t) ^ for all t" is 
equivalent to: there exists to G [0,T] such that A(io) ^ 0. 

Definition 4 The switching functions 4>i{.), i = 1, • • • , m, along an extremal 
(x, X,u) : [0,T] -» R n x R n \{0} x U are defined by: 

& : [0, T] ^ R, fait) = A*(i)ft-(x(i)). (15) 

They are absolutely continuous functions. 



8 



Clearly these functions play a crucial role in the study of time-optimal trajec- 
tories. Indeed, for systems of the form ( p^ ) and under Assumption 1 of Section 
^| on the domain of control, the maximum condition (|l4|) is equivalent to: 

«i(t) = a t if &(t) < and u t (t) = ft if &(t) > 0, (16) 

for i = 1, • • ■ , to. Hence, the zeroes of the switching functions have to be carefully 
analyzed. 

Definition 5 If there exists a nontrivial interval [tiifo] C [0, T] swc/i i/iaf <fo(t) 
is identically zero, the corresponding extremal is called Ui-singular on [ti,^]- 
The component it, o/ £/ie control is then called singular on [ti,t2]- -An extremal 
is called totally singular on [ii,<2] */ ^ is Ui-singular on [t\,t2\ for each i. 
The maximum principle implies that if <fn{t) ^ for almost all t G [0,T] ifte 
component o/ £/ie control is bang-bang, which means that it takes its values 
in {cti,f3i} for almost every t G [0, T]. Assume that the component Ui of the 
control is bang-bang; then t s G [0, T] is called a switching time for m if, for 
each interval of the form }t s — e,t s + e[n[ti,t2], e > 0, there is no constant c 
such that Ui(t) = c for almost all t G [ti, ta] ■ An extremal is called \y\-regular if 
Ui is bang-bang with at most a finite number of switchings. An extremal is said 
to be regular if it is Ui-regular for all i. 

Derivatives of the switching functions The study of the zeroes of the 
switching functions is a key part of our analysis. Let us start by computing the 
first derivative: <f>i(t). It is an easy verification that if X is a smooth vector field 
in M n and (x, A, u) an extremal, then the derivative of the absolutely continuous 
function 1 1— » X t (t)X(x(t)) with respect to t is given by 

m 

A* (t) [/, X] (x(t)) + A* (t) [9j , X] (x(t)) Uj (t) . 

3 = 1 

Hence, since 4>%{t) = X t (t)gi(x(t)), we have, almost everywhere in t: 

m 

Ut) = \\WM*{t)) +J2 Xt ^9j,9i](x(t))u j (t). (17) 

3=1 

Due to the fact that for generic affine control systems the Lie brackets [g,, gj] 
do not commute, i.e. [gi,gj] ^ 0, the appearance of the control in the expres- 
sion for 4>i{.) means that this is in general merely a measurable function, and 
one cannot compute further derivatives. However, when considering controlled 
mechanical systems, Lemmas [l] and || give some additional structure on the Lie 
algebra Cq. In particular, as controls disappear from ([17]), the derivatives of 
the switching functions are themselves absolutely continuous, and one can take 
further derivatives. 

Lemma 3 Assume that the control system is derived from a controlled mechan- 
ical system. Then, if we write A = (Ai, A2) G M r x 1R T , the switching functions 
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depend only on x\ and X2: </>i(t) — X 2 (t)gi(xi(t)), i = 1, • • • , r where the vector 
fields c/i denote the columns ofG. The switching functions are continuously dif- 
ferentiable, their second derivatives exist and are measurable bounded functions. 
We have: 

Mt) = A* (t) [/,<&] (#(*)) (18) 
= -X{(t)F(x 1 {t))g i {x 1 (t)) + X t 2 (t)h i (x 1 (t),x 2 (t)) 

m 

^(^A'Wa^^J + ^yWfeJ/.ffl^Kft). (19) 

3=1 

where the functions hi are given by (^j. In particular, if the system is conser- 
vative or the external forces are of degree at most 2 as a function of xi , then <pi 
is linear as a function of X2 and we have 

A*(t)fe, [f,9i]]{x(t)) = Xl(t)[ 9j , V,9i]](xi(t)) 

with [gj, [f,gi\] an r x 1 vector and [g 3 , [f,9i]](x) = ( -rr-° 

If the system is fully actuated, the second derivative can be written as 

r r 

Ut) = \\t)a# igi (x{t)) + Y, (£^(»(i))ti,(t) (20) 

j=i k=i 

where the <X?j are smooth functions defined by the relations 

r 

[9j, [f,9i\](x) = ^a%{x)g k {x 1 ) . 
fe=i 

When the external forces are of degree at most 2 as functions of X2, the coeffi- 
cients a^j depend only on X\. 

Proof. For a controlled mechanical system with external forces, G is given by 

([7]): G(x) = ( A/ \ J where G is a r X m matrix depending on the r first 

variables x% only. It follows that if A = (Ai, A2) G M r x M r denotes the adjoint 
vector, we have X t (t)gi(x(t)) = X 2 {t)gi{xi(t)) . From Lemma[|, the Lie brackets 
of the vector fields gi vanish, and then ( |l7| ) becomes $i{t) = X 1 (t)[f ', gi](x(t)) 
and is an absolutely continuous function. Computing its derivative we obtain 
( fL9| ) which is a measurable bounded function. Moreover, if N(q, q) is of degree 
at most 2 as a function of q, from Lemma |^ we have \gj, [/, gi]] e V~ 1,0 for all 
i, j = 1, • • • , m. If the system is fully actuated, then there exist smooth functions 
a*j. such that [gj, [/, <?i]](x) = J2l=i a ij( x i)9k(%i), see Lemma [jj. The rest of 
the proof follows easily. 

A complete study of the time-optimal problem includes a complete charac- 
terization of the singular trajectories, an understanding of what concatenations 
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of regular and singular extremals are possible, determination of a bound on the 
number of switching times (if one exists), proof of optimality of a sub-family of 
extremals (an optimal control between two given states is not necessarily unique 
for nonlinear systems), discussion of the regularity of an optimal synthesis, and 
so forth. Each of these questions is highly nontrivial. 

For processes described by linear control systems and under controllability 
and normality conditions, see j4| or || for instance, existence and uniqueness 
theorems for time-optimal controllers are well-known and classical. In fact, in 
that case the conditions of the maximum principle are necessary and sufficient, 
and all time-optimal trajectories are regular. This leads to an optimal synthesis 
where the optimal control is given as a function of the state x G M n . When 
the system is nonlinear, as is the case for most controlled mechanical systems, 
the time-optimal problem becomes much harder. In this paper, we are mainly 
concerned with the existence and characterization of singular extremals. Indeed, 
it is well known that an optimal control may well contain singular pieces. To 
analyze this question, we make use of geometric (Lie-theoretic) techniques. The 
power of such tools in the analysis of nonlinear time-optimal problems has been 
already illustrated by many authors; a good example and source of references is 
the paper [l4| ] dealing with a car-like example with a polyhedral control-value 
set. 

In the next section, we state the main result of this paper and its application 
to mechanical systems. 

3.2 Theorem 

Our main theorem deals with the existence of singular extremals and accumu- 
lation points of zeroes for the switching functions. It gives sufficient conditions 
on the Lie brackets involving the vector fields describing our affine control sys- 
tem under which we can draw conclusions. The application of this theorem to 
investigate time-optimality or lack thereof for system trajectories is illustrated 
in Section ^ for the underwater vehicle example. 

In this section, / denotes the set of the control indices: / = {1, • • • , to}. 

Theorem 1 Let Ki,K 2 <ZI be such that K x r\K 2 = $. 

Assume that (x, X,u) is an extremal defined on [0,T]. If along the extremal 
there exists a finite sequence of nonempty sets J s C J' s _i C J s _i ■ ■ • C J{ C 
J% C Jq = K\ U K 2 such that for every I > 1 we have 

1. Vj G J h 

[gk, ac?y _1 gj] G Span{adJ g v \ w = 0, • • • , I — 1, v G J w } 

Vfc G I; 

2. Vj G J[. 

[g k , ad l f ~ 1 g j ] G Span{adjg v ; w = 0, 1, v G J w } 

Vfc G / where J w — J W \{J W D K 2 }; 
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3. 

Span{ad™ g v ; w = 0, • • • , s, v G J^,} = JR ra 

i/ien either 

a) there exists i 6 K\ such that the extremal is not Uj- singular; 
or 

b) there is no common accumulation point of zeroes of 4>i, i G -Ka- 

If the subset is empty then condition || is equivalent to condition |l| and we 
have J' w = J w . 

As we will see in Section 3.2.1 the following proposition gives information 
on the regularity of the nonsingular controls. 

Proposition 1 Let K\,Ki C I, K\ 0X2 — 0. Assume (x, A, u) is an extremal 
defined on [0, T] with the following properties: 

1. It is Ui- singular for all i G K\. 

2. There is a common accumulation point of zeroes for all tf>i, i G Ki with 
corresponding time to . 

If conditions ^| ; [| of Theorem are satisfied for a finite sequence of nonempty 
sets Ji, J[ (as defined in Theorem^) and K C I\{K\, K2} is such that 

Span{g u , adjg v ;w = 1, • • • , s, u & K x U K 2 U K, v e J w } = M n (21) 

at t = to, then the switching functions <pk, k G K have no common zero at to. 
If K2 is empty, then the switching functions <f>u, k G K have no common zero 
along the whole extremal. 

Detailed proofs of Theorem and Proposition [j] are given in Section 3^3. 
First, we study the consequences on Theorem |l| and Proposition |l| for the special 
structure of the Lie algebra Cq associated to controlled mechanical systems. 

3.2.1 Application of Theorem |l| and Proposition |l| to controlled me- 
chanical systems 

Lemma 4 For a controlled mechanical system, conditions ^ and ^ of Theorem 
^ are automatically satisfied for I — 1 (regardless of the sets K\, Ki). For I = 2 
condition ^ ( resp. condition ^) is equivalent to 

[9k, [f,9j]] G Span{g v ; v G J (resp. Jq)}. (22) 

Moreover, 

Span{adjg v ; w = 0, l,v G J w } has dimension d, (23) 
where d is the cardinality of Jq U Ji . 
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Proof. Condition 13 (resp. ||) for I = 1 is [gk,9j] G Span{g v ; v G Jo} (resp. w € 
Jo). It is automatically satisfied by the commutativity condition: [g k ,gj] = 0, 
see Lemma |l|. Relation (^2|) derives from the fact that the first r-coordinates of 
the vector fields gi and [gk, [f,gj]] are zero (see Lemma [l]) and that the r-first 
coordinates of the vector fields [/, gi] are linearly independent (see Lemma |I|) . 
Indeed, in any linear combination of the vector fields [gk, [f, gj]] in terms of the 
vector fields gi and [/, gi] , the coefficients of the latter must all vanish. From 
Lemma |l| we also know that the set consisting of all the vector fields {gi, [/, gj]} 
is linearly independent, so we conclude that the subset in ((2^) also is. 

Proposition 2 Assume given a fully actuated controlled mechanical system. 
Then: 

1. Along an extremal we cannot have the same accumulation point of zeroes 
for all switching functions (pi, i G I. 

2. Let k be a fixed element of I . Suppose along the extremal there exists 
to G]0,T[ corresponding to a common accumulation of zeroes for all <f>i, 
i k. If <fi k (t ) = 0, then fe (t o ) ^ and if 

Span{gi, [/, g.j] , ad 2 f g ; i,j G I,j ^ k} = R 2r (24) 

at t = to, the switching function (f>k cannot vanish at t = to- 

Proof. The first part of the proposition is proved by applying Theorem [l] to 
K± = 0, Ki = /. Indeed in that case, by taking the sequence Jq = J\ = I 
conditions and || are satisfied (see Lemma [I]). As K\ is empty we deduce 
that there is no accumulation point of zeroes for all switching functions 4>i, 
i G K-2. = I. Assume now that k is a fixed element of / and (x, A, u) an extremal 
with a common accumulation point of zeroes at t = to for all <pi, i ^ k. Since 
the functions <pi are continuously differentiable, this implies that 

M*o) = A*(td)ffi(s(to)) = 0. Mto) = X t {t )[f,g l ]{x(t )) = (25) 

for all i G i ^ k. If <pk and its first derivative vanish at t = to, equations ( p5|) 
are also satisfied for i = k. The vector fields gi, [f,gi] are linearly independent; 
hence this yields a contradiction with the nonvanishing condition for the adjoint 
vector in the maximum principle. 

If, insteaad, ( pi]) is verified, then we can apply Proposition [l] with Ki = 
0, K2 = P\{k} and K = {k}, the sequence of finite sets being given by Jo = 
J 1 = J[ = J 2 = I\{k}. We use the fact from Lemma [j] that the Lie brackets 
of the form [g k , [f,gj]] are obtained as combination over C°°(R 2r ) of the vector 
fields gi. 

An immediate consequence is the nonexistence of totally singular extremal 
for a fully actuated controlled mechanical system. This result was already 
proved for conservative controlled mechanical systems in [pi. 
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Proposition 3 A fully actuated controlled mechanical system (m = r) does 
not have totally singular extremals. More precisely, if k is a fixed element of 
I = {l,---,r} and (x, A, it) is it,- singular for all i / k, the extremal is u k - 
regular. Moreover, if one of these two following conditions is satisfied, then the 
component u k of the control is constant: 

(i) Span{gi, [/, gj], ad 2 g 3 ■; i, j € I,j ^ k} = M 2r along the extremal. 

(ii) The extremal is abnormal, and along this extremal we have 

Span{f,gi, [/,#,-]; i,j €l,j j= k} = R 2r . 



Computation of the singular controls: along a time interval such that 4> k does 
not vanish, the r — 1-singular components of the control are computed from the 
following set of equations: 

X t ad 2 f g l {x)+ a k lk {x)cp k u k - c1 \IU\ (0R \ 

where the coefficients CKy are given by ( p^ j and under the hypothesis that de^a^ix) 
0, j ^ k. 

Proof. The proposition is a corollary of Proposition 0. It can also be proved 
directly by using Theorem^with K\ — I\{k}, K2 = {k} and Proposition Q with 
K\ = I\{k}, K2 = and K = {k}. To prove that u k is constant if condition 
(ii) is satisfied we proceed as follows. Along an extremal that is u^-singular for 
all i yt k, the Hamiltonian function becomes 

H{X{t),x(t),u(t)) = A*(t)/(a;(t)) + 4>k{t)u k {t). 

If the extremal is abnormal, H = 0. Thus, if there exists to such that 4> k (to) = 
we have X t (to)f(x(to)) = (indeed u k is essentially bounded which means 
4>k{t)u k (t) — > as t — > to except at most along a set of measure zero and 
X t f(x) is continuous). This and condition (ii) implies X(to) = which is a 
contradiction. For a fully actuated controlled mechanical system, the second 
derivative is given by (pp|). Using the fact that <pi = for i ^ k, we obtain 
formula (p6|). 

We have already noticed, see Lemma |l|, that for a fully actuated controlled 
mechanical system, the set of vector fields {gi, [f,gi]}i^i generates the set of all 
smooth vector fields on the phase space M 2r . Hence, conditions |l]-|| of Theorem 
can be expressed in term of Lie brackets of length < 2. This is illustrated in 
|H on the underwater vehicle example. We also use in that paper Theorem [l] 
to study extremals with fewer than r — 1 components of the control singular at 
the same time. 

In case the system is underactuated (to < r), sufficient conditions for the 
nonexistence of totally singular extremals are given by Theorem ^ in the follow- 
ing simplified form. 
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Proposition 4 Let k be a fixed element of I = {1, • • • ,m}. Assume the ex- 
tremal (x, A, it) is Ui- singular for all i ^ k on the interval [0, T]. If there exists 
a finite sequence of nonempty sets J s C • ■ • C J 3 C J 2 C I and J\ = Jq = I 
such that along the extremal 

[9k, [f,9j]] G Span{g v ; v G Jo}, Vj £ J 2 ,k G J 
[flfc) od/ -1 ^] G Span{adjg v ; to = 0, — 1, »6 J«,}, Vfc G 7, Z = 3, • ■ • , s 
Span{adJ g v ; w = 0, • • • , s, »6 J^} = _ZR 2 ™, 
t/ien t/ie extremal cannot be totally singular. 

To obtain information on the nonsingular component of the control we refer 
to Proposition |l|. Proposition ^ will be illustrated on an underwater vehicle 
example in Section ^. 

3.3 Proofs of Theorem and Proposition [l] 

Let us first prove the following technical lemma. 

Lemma 5 Let h : [0, T] — > 1R be an absolutely continuous function. Assume 
that its first derivative ( defined almost everywhere ) is of the form 

h(t) = a{t)+0{t), 

where a : [0, T] — ► M is a continuous function and (3{.) is essentially bounded. 
Then, if h(.) has an accumulation point of zeroes at t = to G]0, T[ such that 
(3(t) — ► as t — > to (except along a set of zero measure), we have a(to) = 0. 

Proof. An absolutely continuous function h(.) is differentiable at almost all 
points of its definition interval. Assume h(t) = a(t) + (3(t) with a, (3 as stated 
in the lemma, then h : [0, T] — > M is a measurable bounded function. Suppose 
h(.) has an accumulation point of zeroes at t = to an d (3(t) — + as t tends to 
to. Assume a(t ) = c > 0. Then there exists e > such that | < + /?(<) 
almost everywhere on the interval ]to — e,to + e[- This is equivalent to saying 
that there exists a set F C [0, T] of measure zero such that if t G]to — e, to + eiV-F 1 
then h(t) > |. For t > < > ^(*) = ^(*o) + J to h(r)dT and /i(to) = 0. So, we have 
h(t) > %{t — to) > (if t < to, we have h(t) < 0). Hence h{.) is a strictly 
increasing function in a neighborhood of to which contradicts the fact that to is 
an accumulation point of zeroes. If we assume c < 0, then we obtain the same 
contradiction with h(.) a strictly decreasing function. 
Let us now prove Theorem [jj. 

3.3.1 Proof of Theorem [j] 

By assumption, there exists K\, K% C I and a sequence of nonempty sets Ji, J- 
as stated in the theorem such that conditions and || are satisfied. Assume the 
extremal (x, A, u) is u^-singular for all i G and has a common accumulation 
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point of zeroes for all <fii, i £ -K2. We will prove that it leads to a contradiction 
with the necessary conditions of the maximum principle. In the rest of the 
proof, we will denote by to G]0,T[ any fixed time corresponding to a common 
accumulation point of zeroes for ^, i 6 K 2 . If K% is empty, to just denotes an 
arbitrary time (in particular in that case formula ( |3l| ) is true for all t) 

Assume that the extremal is defined on the time interval [0, T]. 

CLAIM: If j G Ji, the corresponding switching function <pj is of class C 1 ^ 1 , 
the l-th derivative exists, it is measurable bounded, and we have the following 
relations: 

• Case I = 0: 

<Pj(t) = X*(t) gj {x(t)) = 0, Vi G [0,T],j G A 1; (27) 
0j(t o ) = A 4 (t )ft(x(t )) = 0, j G A 2 . (28) 

• Case / > 1: 

For c = 0, • • - 1: 

0j c) (t) = A*(t)od^(a:(t)) = 0, Vi G [0, 7], j G J c n Xi, (29) 
0} c) (* o ) = \\to)ad c fgj {x(to)) - 0, j G J c n A 2 , (30) 

and 

A*(to)a4 Sj -(a:(to)) = 0, Vj G J;. (31) 
Moreover, the derivatives may be expressed as follows: 

<f>V(t) = \\t)ad) gi (x{t% Vt G [0,T], j G J^, (32) 

m 

</f(i) = X^adffgM*)) + E a4 _1 ffi]«*(t), J G J/_ X) (33) 

fe=i 

for almost every i. 
Proo/ 0/ CLAIM. 

First assume Z = . In this case, we have Jo = K\ U X 2 . If the extremal is 
Ui-singular for all i G Ai, the corresponding switching functions are identically 
zero on [0, T]: <pi = 0. In terms of vector fields, the following equations must be 
satisfied for all i G K\ : 

<t>i{t) = A*(t) 5i (a;(t)) = 0,Vt G [0,T]. (34) 

This is exactly (p7|). Moreover, relation (Q) evaluated at £ = to is satisfied for 
all i G A 2 which is equivalent to pgj). 

Assume now / — 1 . Notice that in this case equations (^9|) and ( |30"| ) are 
exactly ( |27| ) and (^8|), which we just proved. The switching functions being 
identically zero for all i G Ki, we have in particular that their first derivatives, 
which are measurable bounded functions, vanish almost everywhere: 

m 

Mt) = A* (t) [/, gi] (x{t) ) + E A * (*) Iff fc ' 9i] (x(t))u k (t) = (35) 

fe=i 
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for a.e. t € [0, T], Vi € i^i- From condition [j] of the theorem, if j G Ji we have 
[Pfeiffj] G Span{g v ; v 6 J }, Vfc S I. 



Hence, a consequence of ( 27|) and (28) is that A*(to)[fffcjflj](aj(to)) = for all 
j G Ji,fc G I. Equation (3q) implies then that A*(to)[/, 9j]( x {to)) = for all 
j G Ji n i^i. Indeed, as the components of the control are essentially bounded 
functions the terms A* gj](x(t))uk(t) tend to as t tends to to except at 
most along a set of measure zero. Now, since cbj = and A'(t)[/, gj](x(t)) is 
continuous, the latter function must vanish i . This gives equation ( pl| ) for 
j G Ji fl ifi . To prove that this equation is also true for j G J\ n we proceed 
as follows. Formula (|l^) for the first derivative of the switching functions holds 
for any i £ I, not only under singularity assumptions. Hence if j G J\ (~l i^, 
we have an accumulation point of zeroes at to and 4>j (t) is given by ( p7| ) where 
A'(to)[ff/c, i?j](a ; (io)) = for all k <E I. The situation is covered by Lemma || with 
h(t) = <P 3 (t), a(t) = A*(t)[/,&-](a;(t)) and /3(i) = A*(t)[ff fc , <fe](a:(t)). Hence we 
can conclude that a{to) = for all j G J\C\Ki. 

Let us next deal with the case I = 2 ; the generalization to arbitrary I will 
be then clear. By definition Ji C J[. Let us then first describe condition || for 
1 = 1. If j G </{ and as Jo\{<^o n -K2} = K\ we have 

[ffk.ffi] G Span{g v ; v G i^i}. 

Hence equation ( p7| ) implies that A*(t)[<7fc, <7j](a:(i)) is identically zero along the 
extremal, for all j G J[, k G I. This means that for j G J[ , the first derivative of 
4>i is absolutely continuous and is given by (j>j(t) = X t (t)[f,gj](x(t)), Vi G [0, T]. 
We then can compute the second derivative for these switching functions and 
obtain: 

m 

4>,(t) = \\t)ad} 9j {x{t)) +E [/,<&]](s(*))«k(*), J G ^- (36) 

fe=i 

This is a measurable bounded function. Now, if j G J2 we have also from 
condition [l] that 

[fffc, G Span-te^LAftoJ; w G J ,Ui G JJ. 

Hence, from equations (|29j)- (^TJ) for c = 0, I = 1, we obtain the relation 
A*(to)[flfe) [/j&'IK^C^o)) = for all j G Ji^k G J. Using this last relation, (|36|), 
and Lemma pi in a similar way to what was done in the case I = 1 , we complete 
the proof of the claim for 1 = 2. 

Finally, we sketch the general case. Let 3 < I < s where s is as stated in 
the theorem and assume the claim is satisfied for any < c < I. Then under 
the assumptions of the theorem we will prove that the claim is true for I. As 
the claim is true for < c < I, the switching functions <j>j, j G J\-\ are of class 
C( l ~ 2 \ and their I— 1-th derivatives exist and are measurable bounded functions 
given by j33|). From condition]]], if j G J; we have 

[gk, adj -1 ^-] G Span{ad™ g v ] w = — 1, v £ J w }. 
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Using equations (29)-(p0[) for < c < I — 1, we obtain the following relation: 
X t (to)[gk, ady 1 gj](x(t a )) = 0, for all j G Ji,k e I. We complete the proof the 
same way as done for the cases I = 1 and 1 = 2, appealing to Lemma pi. 

Having proved the claim, we are almost done with the proof of Theorem 
Indeed condition || and relations ( |3l| ) satisfied for I = 0, ■ • • , s imply a contra- 
diction with the fact that the adjoint vector cannot vanish along an extremal. 
Hence, either there exists i G K\ such that the extremal is not u^-singular, or 
there is no common accumulation point of zeroes of <pi , i G K% . 

3.3.2 Proof of Proposition [j] 

Following the proof of Theorem |l| we have for I > 0: 

\ t (t )ad l f9j (x(t )) = VjeJi. (37) 

Moreover, if we have at t = to a common zero for the switching functions 
k G K the following relation is true: 

X t (t )g k (x(to))=0 VkeK. (38) 

Equations (|37|)-(|3^) and the condition given by formula ( pl| ) imply A(£o) = 0. 
This contradicts the maximum principle. In the case where K 2 = 0, equation 
( |37j ) is satisfied for all t. This completes the proof. 

3.4 Concatenation of singular extremals 

In order to understand optimal strategies, it is essential to determine which con- 
catenations of pieces of extremals are allowed. This problem is in general very 
difficult. The following is a result on the concatenation of singular extremals 
along an optimal trajectory. 

Proposition 5 Let Si, S2 be nonempty subsets of I. For a =1,2, let (x a , \ a , u a ) 

be a Ui-singular extremal for all i G S a and defined on a time interval [0,T a ]. 
Assume x l (Ti) = x 2 (0). If for a = 1,2, along (x a ,\ a ,u a ) there exists a se- 
quence of nonempty sets J° C J* —1 C • • • C J£ C = S a such that for every 
I > 1 we have: 

1. Vj G Jt, 



[g k , ad f gj] G Span{adjg v ; w = 0, • • • , I - 1, v G J^} 



Vfc G /. 



Span{adyg v (0); w = 0, • • • , s, v G U J 2 W } = ST 
Then, the concatenation (x,X,u) obtained by 



(x(t),X(t),u(t)) = 
is not an extremal. 



(x 1 (t),X 1 (t) i u l (t)) te[o,T x ] 
{x 2 (Ti -t),X 2 {Ti -t),u 2 (Ti -t)) t€ [Ti,Ti+T 2 ] 
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Proof. First note that if (x 2 (t) , X 2 (t) , u 2 (t)) is an extremal defined on [0,T 2 ] so 
is (x 2 (T 1 -t),X 2 (Ti-t),U2(Ti-t)) defined on [T 1 ,T 1 +T 2 ]. Hence, let us assume 
(x 2 , A 2 , u 2 ) is defined on [Ti, T\ + T 2 \. As the adjoint vector is defined modulo 
a multiplicative factor, we can assume A 2 (Ti) to be any arbitrary value, and, 
in particular, we can assume A 2 (Ti) = A 1 (Ti). If the concatenation {x,X,u) 
is an extremal then A : [0, T\ + T 2 ] — > _ZR™\{0} is an absolutely continuous 
function satisfying equations ([l3]) . Under condition [j], using a similar proof as 
for Theorem |l| (with K 2 = 0) we can show that for j 6 Jj 1 : 

\*(t)a(F f gj(x(t)) = 0, c =(),■■■, I (39) 

for every t £ [0, Ti] if a = 1 and every f e [Ti, Ti + T 2 ] if a = 2. Hence, equation 
( |39| ) and Condition |^ imply A(Ti) = which contradicts the maximum principle. 

Applying this result to underwater vehicles, we will prove that some specific 
trajectories in the fully actuated situation are not optimal. Before doing so, we 
first give a result for fully actuated controlled mechanical systems. 

Proposition 6 Consider a fully actuated controlled mechanical system. Then, 
an optimal trajectory cannot be the concatenation of a Ui-singular extremal for 
all i £ Si d I and of a Ui-singular extremal for all i G S 2 C I if Si U S 2 = I . 

Proof. This is a direct consequence of Proposition || (take the sequences Jq = 
J? = S a ). 



4 Application to underwater vehicles 

Our application concerns the motion planning problem for underwater vehicles. 
For such vehicles, it is not only worthwhile to minimize the energy spent to carry 
out a desired motion, but one is often also concerned with the continuous power 
consumption of all devices on board, such as sensors and computers. Because 
of this last quantity ( "hotel load" ) , the amount of time used to travel between 
two desired configurations becomes a minimization criteria for our performance 
requirements. This section contains those results obtained from Theorem ^ 
when applied to such systems. Details of the computations, proofs, and more 
information about time-optimal trajectories, can be all found in |, |. In g, 
we also include a brief discussion on energy minimization, and its relation with 
some recent discoveries on marime mammals diving. 

The dynamics of underwater vehicles can be described with the equations 
of motion as follows, see H for more details. The position and orientation of 
the underwater vehicle are identified with the group of rigid-body motions in 
1R 3 : SE(3) = {(Rib); R 6 50(3), b e M 3 }. If we define fl = (fii,n 2 ,0 3 ) and 
v = (vi,v 2 ,V3) to be the angular and translational velocity of the vehicle in 
body coordinates (see figure [j]), then the kinematic equations are 

/ o -n 3 n 2 \ 

R = R(l, Q = fl 3 -fti (40) 

V -fi 2 fii o / 
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Figure 1: underwater vehicle 

b = Rv. (41) 

We begin by assuming the vehicle is submerged in an infinitely large volume 
of incompressible, irrotational and inviscid fluid at rest at infinity. Let us denote 
by II and P the angular and linear components of the impulse (roughly equiv- 
alent to momentum) of the body-fluid system with respect to the body-frame. 
The Kirchhoff equations of motion for a rigid body in such an ideal fluid are 
given by 

tl = HxQ + Pxv + T, P = P x!l|J (42) 

where r and T are external torque and force vectors, r and T can be used to 
include gravity, buoyancy and control forces as well as viscous forces such as lift 
and drag. Notice that II and P can be computed from the total kinetic energy 
T of the body fluid system: T = ±(n t ,m + 2n t Dv + v t Mv), where M and J are 
respectively the body-fluid mass and inertia matrices. In [pi, the Hamiltonian 
structure of the dynamics of the underwater vehicle is described. 

We consider a neutrally buoyant, uniformly distributed, ellipsoidal vehicle 
moving in the vertical inertial plane and we neglect viscous effects. We denote 
by [x, z) the absolute position of the vehicle where x is the horizontal position 
and z the vertical position. 9 describes its orientation in this plane so that 
q = (x,z,9), see figure |[ Given our assumptions, M and J are diagonal and 
D = so that for our vehicle restricted to the plane T — \{IQ 2 +mivf +TO3w|) 
where / is the body-fluid moment of inertia in the plane and mi, 7713 are body- 
fluid mass terms in the body horizontal and vertical directions, respectively. We 
assume that mi ^ 7713, i.e., the planar vehicle is not a circle. We choose the 
state vector to be w = (x, z, 9, v±, V3, Q). Here Q is the scalar angular rate in 
the plane. The equations of motion of this mechanical system are 

x = cos 9v\ + sin 9v% 
z = cos 9v3 — sin 6v\ 
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Figure 2: planar version 
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Let us consider the fully actuated case: the control vector is u — (ui, U2,u 3 ) 
where ui is a force in the body 1-axis, is a force in the body 3-axis and u 3 is 
a pure torque in the plane. Accordingly, with the drift vector field / given by 
the planar equations of motion (E4I) , the input vector fields gi are given by 
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This formulation of 



With respect to the notations of Section 2.1 the change of variables on the 
phase space is given by: ip = Identity and P^ 1 (w) — Q(w) where Q(w) is a 

rotation matrix J V R(6) = ( "»f a 

y 1 J w y - sm cos ( 

the problem (instead of considering the velocities expressed in the inertial frame 

coordinates) leads to simpler computations for the Lie brackets and to a nice 

geometric interpretation of the results. 

The following result is an immediate consequence of Proposition ^|. 

Proposition 7 There is no totally singular extremal in the time- optimal prob- 
lem for fully actuated underwater vehicles. 
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As a particular consequence, if the underwater vehicle follows the equation of 
motion of the conservative mechanical system (which corresponds to the control 
identically zero), such a motion is not time-optimal. In fact, from Proposition^ 
we have more information: along an extremal, there cannot exist any common 
accumulation point of zeroes for all switching functions. 

Thus, we must first study extremals with at most two components of the 
control singular at the same time. From Proposition ^ we know that the non- 
singular component of the control is regular and constant if certain Lie brackets 
conditions are satisfied. Let us describe more precisely what happens in the 
case of the fully actuated underwater vehicles. The Lie algebra generated by 
the Lie brackets of the vector fields /, gi is central to the characterizations of 
time optimal paths, and hence is the key to the proofs of the results which 
we are stating here. In order to avoid overlaoding with formulas, we refer the 
reader interested in by the computations and the structure of the Lie algebra 
to J|, [|. Observe that, using notations and Lemmas of Section ||, we have the 
following facts: Our underwater vehicle is a conservative controlled mechanical 
system, hence there are no external forces and we have / £ Vg 1 ' 2 . It follows 
that ad^gi G ,s and [<?j, adjgj] £ V£~ ,s ~ (this is verified in ||, where 
the Lie brackets are computed). The next proposition describes the 2-singular 
extremals. 

Proposition 8 

• Along a ux, u-^-singular extremal, the component u% of the control is regu- 
lar, and has at most one switching contained in the set {w; v\ = v$ = 0}. 
If there is one, then v\ = 773 = along the extremal, and the singular 
components of the control are identically zero. The corresponding motion 
for the underwater vehicle is a pure rotation with angular velocity varying 
linearly. 

• Let i e {1,2} and k be such that k = 1 if i = 1, and k = 3 if i = 2. 
Along a Ui,u 3 - singular extremal, there is at most one switching for the 
nonsingular component of the control and this switching is contained in the 
set {w; Vk = Q = 0}. Moreover, if there is one switching, then £7 = and 
Vk = 0, and both singular components of the control are identically zero. 
The corresponding motions for the underwater vehicle are translations in 
the direction of the vertical (if i = 1) and horizontal (if i — 2) axis of 
the body frame coordinates, and the velocity of these translations depends 
linearly on t. 

• Along an abnormal extremal with 2 singular components of the control, 
there is a switching at the time t s only if the underwater vehicle is at rest 
att = t s : vi(t s ) = v 3 (t s ) = ft(t s ) = 0. 

In m we describe an algorithm to compute the singular components of the 
control when there is no switching and illustrate our results with simulations. 
The previous proposition shows that along a 2-singular extremal there is at 
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Figure 3: initial and final position 

most one switching for the nonsingular component of the control. This is an 
important result, indeed the existence of a uniform bound is not a consequence 
of the maximum principle. This is a well-known question in optimal control: in 
[ p~2| for instance, the author provides an example of optimal trajectories with an 
infinite number of switchings. A crucial question is: is there a uniform bound on 
the number of switchings for all optimal trajectories? This is a highly nontrivial 
question, and we will try to give at least partial answers in forthcoming articles. 

Conversely to Proposition ||, the following proposition states that the three 
basic motions: pure rotation, on and translations in the direction of the axis of 
the body frame coordinates, are 2-singular extremals. 

Proposition 9 If along a trajectory we have Vx = and t>3 = 7 then the 
trajectory is a u\,U2~ singular extremal with at most one switching. The corre- 
sponding motion is a pure rotation and the singular components of the control 
are identically zero: u\ = u-i = 0. // along a trajectory we have Q = and 
vi = (resp. W3 = 0), then the trajectory is a u\, 1x3- singular extremal (resp. 
112,113) with at most one switching for ui (resp. u\). The corresponding motion 
is a translation in the direction of the vertical (resp. horizontal) axis of the body 
frame coordinates. 

We conjecture the time-optimality of these basic motions. THis would imply 
that one cannot restrict the study to bang-bang trajectories when dealing with 
time-optimality for such systems. 

Let us use Proposition ^ to discuss the optimality of some specific trajecto- 
ries. Consider the initial and final positions illustrated in figureH. Assume the 
underwater vehicle to be at rest at these positions. On figure |and I we rep- 
resent two different ways to connect these positions; these are concatenations 
of vertical and horizontal translations (the orientation is fixed along the mo- 
tion) . Using the result given in Proposition ^ on the concatenation of singular 
extremals in the fully actuated situation, we can prove that these trajectories 
are not optimal. 
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Figure 4: vertical + horizontal translation 



- 




Figure 5: horizontal + vertical translation 
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Figure 7: path 1 



More generally, we have the following result. Let Wi and wt arbitrary initial 
and final positions such that the velocities are all zero. We can reach these 
two positions by a motion formed by pure rotation and pure translations in the 
direction of the axis of the body frame coordinates. This is illustrated by figure 
and 0. We know that these trajectories are not optimal. The nonoptimality of 
such trajectories is guaranteed by the fact that pure translational and rotational 
motions are necessarily 2-singular extremals, and by Proposition [| which does 
not allow concatenations of 2-singular extremals in our case. 

In order to obtain more information on the stucture of the time-optimal 
trajectories, we also need to study extremals with only one component of the 
control being singular, as well as trajectories with all components of the control 
bang-bang. This will be done in a forthcoming article using results presented 
in the previous sections. For instance, Proposition |^ gives information about 
extremals with one component singular only. 
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Proposition 10 Let {i,j, k} e {1, 2, 3} such that i ^ j ^ k. If the extremal is 
Ui -singular, then <pj and 4>k cannot have a same accumulation point of zeroes. If 
there exists to such that 4>j(to) = (f>k(to) = 0, we have 4>j(to) ^ or cf>k(to) =f= 0. 

As we already mentionned in this paper, our main result does not apply 
exclusively to the fully actuated situation. In a forthcoming article, we will study 
underactuated situations. These situations will be motivated by a buoyancy 
driven underwater vehicle; see for a first approach. 
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